منابع مشابه
Reducing Variance in Univariate Smoothing
A variance reduction technique in nonparametric smoothing is proposed: at each point of estimation, form a linear combination of a preliminary estimator evaluated at nearby points with the coefficients specified so that the asymptotic bias remains unchanged. The nearby points are chosen to maximize the variance reduction. We study in detail the case of univariate local linear regression. While ...
متن کاملVariance Reduction in Smoothing Splines
We develop a variance reduction method for smoothing splines. We do this by showing that the quadratic interpolation method introduced in Cheng et al. (2006), for local linear estimators, also works for smoothing splines. For a given point of estimation, Cheng et al. (2006) define a variance-reduced local linear estimate as a linear combination of classical estimates at three nearby points. We ...
متن کاملOnline Variance-reducing Optimization
We emphasize the importance of variance reduction in stochastic methods and propose a probabilistic interpretation as a way to store information about past gradients. The resulting algorithm is very similar to the momentum method, with the difference that the weight over past gradients depends on the distance moved in parameter space rather than the number of steps.
متن کاملLikelihood and Smoothing Spline Analysis of Variance
We discuss a class of methods for the problem of `soft' classi cation in supervised learning. In `hard' classi cation, it is assumed that any two examples with the same attribute vector will always be in the same class, (or have the same outcome), whereas in `soft' classi cation, two examples with the same attribute vector do not necessarily have the same outcome, but the probability of a parti...
متن کاملSmoothing Spline Estimation of Variance Functions
This article considers spline smoothing of variance functions. We focus on selection of smoothing parameters and develop three direct data-driven methods: unbiased risk (UBR), generalized approximate cross validation (GACV) and generalized maximum likelihood (GML). In addition to guaranteed convergence, simulations show that these direct methods perform better than existing indirect UBR, genera...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
ژورنال
عنوان ژورنال: The Annals of Statistics
سال: 2007
ISSN: 0090-5364
DOI: 10.1214/009053606000001398